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DETAILED ACTION 

Response to Arguments 

1 . Applicant's arguments filed 28 April 2009 have been fully considered but they are 
not persuasive. 

In response to applicant's arguments regarding "the multimedia 
document... (SMIL) document", Page 16, lines 7-9, the Examiner respectfully 
disagrees. Piotrowski teaches transmitting SMIL multimedia documents 
automatically or by request. The SMIL document provides the user with access 
to supplemental information that is synchronized to the current television 
program. These are synchronized using extracted time codes from the television 
program and the supplemental information. The combination of Piotrowski, 
Blackketter, and Eng teaches transmitting/receiving a SMIL document along with 
its associated data and synchronizing the data using a global system clock. 
Therefore, the combination of the references teaches the aforementioned 
limitation. 

2. Applicant's other arguments with respect to claims 1, 6, 16, 17, 22, 32, and 33 
have been considered but are moot in view of the new ground(s) of rejection. 

Claim Objections 

3. Claim 2 is objected to under 37 CFR 1 .75(c), as being of improper dependent 
form for failing to further limit the subject matter of a previous claim. Applicant is 
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required to cancel the claim(s), or amend the claim(s) to place the claim(s) in proper 
dependent form, or rewrite the claim(s) in independent form. Claim 2 includes the same 
claim language as a limitation in claim 1. 

4. Claim 35 is objected to because claims 18 and 23 were canceled thereby 
rendering the claim dependent upon canceled claims. Appropriate correction is 
required. 

Claim Rejections - 35 USC § 103 

5. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 1 02 of this title, if the differences between the subject matter sought to be patented and the prior art 
are such that the subject matter as a whole would have been obvious at the time the invention was made to 
a person having ordinary skill in the art to which said subject matter pertains. Patentability shall not be 
negatived by the manner in which the invention was made. 

6. Claims 1 -3, 5,6,8,1 0-1 7, 19,21, 22, 24, 26-32, and 35-37 are rejected under 35 
U.S.C. 103(a) as being unpatentable over Piotrowski (US 2002/0188959) in view of 
Blackketter (US 6,415,438) and further in view of Eng (US 5, 963,557). 

Regarding claim 1 , Piotrowski teaches an apparatus for transmitting 
multimedia broadcasting (Fig. 1, el. 19), comprising: 

a reference clock generator/transmitter, which generates and transmits a 
reference clock value of real-time multimedia broadcasting (Para. 25, 31-38); 

a multimedia document generator/transmitter, which generates and 
transmits a multimedia document scheduled at the generated reference clock 



Application/Control Number: 10/629,717 Page 4 

Art Unit: 2427 

value, i.e. web server generates and transmits scheduled SMIL documents 
(Para. 19, 29-38); and 

a media data generator/transmitter, which generates and transmits media 
data used to render the generated multimedia document, i.e. web server 
generates and transmits supplemental multimedia information which includes 
audio and video (Para. 24, 29-38); 

wherein the multimedia document is a synchronized multimedia 
integration language (SMIL) document (Para. 31-38). 

Piotrowski does not clearly teach the reference clock value is a current 
time value of real-time multimedia broadcasting at the transmission and reception 
locations. 

Blackketter teaches a reference clock generator/transmitter, which 
generates and transmits a reference clock value, which is a current time value of 
multimedia broadcasting and using the time to schedule multimedia, i.e. the 
current date and time can be periodically broadcasted to the receiver unit (Col. 5, 
lines 5-40). 

Therefore, it would have been obvious to one of ordinary skill in the art at 
the time the invention was made to modify Piotrowski to include generating and 
transmitting a reference clock value which is a current time value of real-time 
multimedia broadcasting, as taught by Blackketter, for the purpose of eliminating 
the need for a trigger script and delay loop by using wall-clock time with a trigger 
transmitted before its associated execution time (Blackketter-Col. 2, lines 39-50). 
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Eng teaches a synchronizer located at a head-end that maintains a 
system clock and periodically broadcasts time stamps to the subscriber stations 
in order to maintain synchronization between the head-end and the stations (Col. 
17, lines 22-46). 

Therefore, it would have been obvious to one of ordinary skill in the art at 
the time the invention was made to have the reference clock 
generator/transmitter of Piotrowski in view of Blackketter to generate and 
transmit a reference clock value which is a current time value of real-time 
multimedia broadcasting at the transmission and reception locations, using the 
known method of generating and periodically transmitting a locally generated 
system clock value to subscriber stations in order to ensure synchronization, as 
taught by Eng, in combination with the system taught by Piotrowski in view of 
Blackketter, for the purpose of providing the user with a better overall viewing 
experience by having the receiver synchronized to the clock at the transmitter, 
thereby reducing lag time and errors. 

Regarding claim 2, Piotrowski (Para. 31-38) in view of Blackketter in view 
of Eng teaches the multimedia document is a synchronized multimedia 
integration language (SMIL) document. 



Regarding claim 3, Piotrowski (Para. 31-38) in view of Blackketter (Col. 5, 
lines 5-40) in view of Eng (Col. 17, lines 22-46) teaches the reference clock 
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generator/transmitter, the multimedia document generator/transmitter, and the 
media data generator/transmitter transmit the reference clock value, the 
multimedia document, and the media data, respectively, in the form of a 
predetermined data stream, i.e. transmitting the current date and time, the SMIL 
document, and the linked media. 

Regarding claim 5, Piotrowski in view of Blackketter in view of Eng 
teaches the reference clock generator/transmitter transmits the reference clock 
value, which increases by a predetermined value, whenever the reference clock 
value increases by the predetermined value, i.e. periodically broadcasting the 
current time to the receiver (Blackketter-Col. 5, lines 21-33; Eng-Col. 17, lines 
22-46). 

Regarding claim 6, Piotrowski teaches an apparatus for receiving 
multimedia broadcasting (Fig. 1, el. 11, 12, 14), comprising: 

a reference clock receiver, which receives a reference clock value of real- 
time multimedia broadcasting, i.e. receiving a time code embedded in the media 
(Para. 25, 31-38); 

a multimedia document receiver/storage, which receives and stores a first 
multimedia document, Note: the multimedia document must be at least 
temporarily stored while it is being analyzed (Para. 19, 25, 28, 31-38, 45); 
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a media data receiver/storage, which receives and stores first media data, 
i.e. media data may be recorded (Para. 19, 25, 28, 31-38, 45); and 

a multimedia document renderer, which when the first multimedia 
document is scheduled at the reference clock value and first media data is a 
rendering material used to render the first multimedia document, renders the first 
multimedia document using the first media data (Para. 30-38); 

wherein the multimedia document is a synchronized multimedia 
integration language (SMIL) document (Para. 31-38). 

Piotrowski does not clearly teach the reference clock value is a current 
time value of real-time multimedia broadcasting at the transmission and reception 
locations. 

Blackketter teaches a reference clock generator/transmitter, which 
generates and transmits a reference clock value, which is a current time value of 
multimedia broadcasting and using the time to schedule multimedia, i.e. the 
current date and time can be periodically broadcasted to the receiver unit (Col. 5, 
lines 5-40); and a multimedia document receiver/storage, which receives and 
stores a multimedia document, i.e. prefetching web pages using triggers (Col. 6, 
line 60-Col. 7, line 7). 

Therefore, it would have been obvious to one of ordinary skill in the art at 
the time the invention was made to modify Piotrowski to include generating and 
transmitting a reference clock value which is a current time value of real-time 
multimedia broadcasting, as taught by Blackketter, for the purpose of eliminating 



Application/Control Number: 10/629,717 Page 8 

Art Unit: 2427 

the need for a trigger script and delay loop by using wall-clock time with a trigger 
transmitted before its associated execution time (Blackketter-Col. 2, lines 39-50). 

Eng teaches a synchronizer located at a head-end that maintains a 
system clock and periodically broadcasts time stamps to the subscriber stations 
in order to maintain synchronization between the head-end and the stations (Col. 
17, lines 22-46). 

Therefore, it would have been obvious to one of ordinary skill in the art at 
the time the invention was made to have the reference clock 
generator/transmitter of Piotrowski in view of Blackketter to generate and 
transmit a reference clock value which is a current time value of real-time 
multimedia broadcasting at the transmission and reception locations, using the 
known method of generating and periodically transmitting a locally generated 
system clock value to subscriber stations in order to ensure synchronization, as 
taught by Eng, in combination with the system taught by Piotrowski in view of 
Blackketter, for the purpose of providing the user with a better overall viewing 
experience by having the receiver synchronized to the clock at the transmitter, 
thereby reducing lag time and errors. 

Regarding claim 8, Piotrowski (Para. 31-38) in view of Blackketter (Col. 5, 
lines 5-40) in view of Eng (Col. 17, lines 22-46) teaches the reference clock 
receiver, the multimedia document receiver/storage, and the media data 
receiver/storage receive the reference clock value, the first multimedia document, 
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and the first media data, respectively, in the form of a predetermined data 
stream, i.e. transmitting the current date and time, the SMIL document, and the 
linked media. 

Regarding claim 10, Piotrowski in view of Blackketter in view of Eng 
teaches the reference clock generator/transmitter transmits the reference clock 
value, which increases by a predetermined value, whenever the reference clock 
value increases by the predetermined value, i.e. periodically broadcasting the 
current time to the receiver (Blackketter-Col. 5, lines 21-33; Eng-Col. 17, lines 
22-46). 

Regarding claim 1 1 , Piotrowski in view of Blackketter in view of Eng 
teaches a first multimedia document is not scheduled at a reference clock value, 
a multimedia document Tenderer stands by until receipt of a predetermined 
reference clock value at which the first multimedia document is scheduled, i.e. 
the SMIL document media components are scheduled and synchronized using 
broadcasted trigger time codes (Piotrowski-Para. 31-38; Blackketter-Col. 5, lines 
5-40; Eng-Col. 17, lines 22-46). 

Regarding claim 12, Piotrowski in view of Blackketter in view of Eng 
teaches transmitting a trigger, which contains a future presentation time attribute 
and a URL, prefetching the information resource contained at the URL, and 
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executing the trigger at the future time (Blackketter-Col. 5, lines 5-40; Col. 6, line 
60-Col. 7, line 25). Therefore, Piotrowski in view of Blackketter teaches when the 
first multimedia document is scheduled at the reference clock value but the first 
media data is not a rendering material used to render the first multimedia 
document, the multimedia document renderer holds the first media data in 
standby and then uses the first media data when rendering a second multimedia 
document, whose rendering material is the first media data and which is 
scheduled at a predetermined reference clock value, i.e. rendering the 
multimedia document and its associated media data at the scheduled time 
(Piotrowski-Para. 28; Blackketter-Col. 5, lines 5-40; Col. 6, line 60-Col. 7, line 25; 
Eng-Col. 17, lines 22-46). 

Regarding claim 13, Piotrowski in view of Blackketter in view of Eng 
teaches transmitting a trigger, which contains a future presentation time attribute 
and a URL, prefetching the information resource contained at the URL, and 
executing the trigger at the future time (Blackketter-Col. 5, lines 5-40; Col. 6, line 
60-Col. 7, line 25). Therefore, Piotrowski in view of Blackketter teaches when a 
first multimedia document under rendering is not scheduled at a predetermined 
increasing reference clock value, i.e. the trigger has expired or the multimedia 
document is finished (Blackketter-Col. 8, lines 15-49; Col. 10, lines 44-50), the 
multimedia document renderer stops rendering the first multimedia document 
and then renders a second multimedia document scheduled at the 
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predetermined increasing reference clock value when the second multimedia 
document has been stored, i.e. the trigger for the new multimedia document is 
executed and the document is rendered (Blackketter-Col. 5, lines 5-40; Col. 6, 
line 60-Col. 7, line 25; Eng-Col. 17, lines 22-46). 

Regarding claim 14, Piotrowski in view of Blackketter in view of Eng 
teaches transmitting a trigger, which contains a future presentation time attribute 
and a URL, prefetching the information resource contained at the URL, and 
executing the trigger at the future time (Blackketter-Col. 5, lines 5-40; Col. 6, line 
60-Col. 7, line 25). Therefore, Piotrowski in view of Blackketter teaches when a 
first multimedia document under rendering is not scheduled at a predetermined 
increasing reference clock value, i.e. the trigger has expired or the multimedia 
document is finished (Blackketter-Col. 8, lines 15-49; Col. 10, lines 44-50), the 
multimedia document Tenderer stops rendering the first multimedia document 
and then receives and stores a second multimedia document scheduled at the 
predetermined increasing reference clock value when the second multimedia 
document has not been stored (Blackketter-Col. 5, lines 5-40; Col. 6, line 60-Col. 
7, line 25; Eng-Col. 17, lines 22-46). 

Regarding claim 15, Piotrowski in view of Blackketter in view of Eng 
teaches transmitting a trigger, which contains a future presentation time attribute 
and a URL, prefetching the information resource contained at the URL, and 
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executing the trigger at the future time (Blackketter-Col. 5, lines 5-40; Col. 6, line 
60-Col. 7, line 25). Therefore, Piotrowski in view of Blackketter in view of Eng 
teaches when a first multimedia document under rendering is not scheduled at a 
predetermined increasing reference clock value, i.e. the trigger has expired or the 
multimedia document is finished (Blackketter-Col. 8, lines 15-49; Col. 10, lines 
44-50), the multimedia document renderer stops rendering the first multimedia 
document and then receives and stores second media data used to render a 
second multimedia document scheduled at the predetermined increasing 
reference clock value when the second multimedia document has been stored, 
but the second media data has not been stored, i.e. the second multimedia 
document has been prefetched (Piotrowski-Para. 28; Blackketter-Col. 5, lines 5- 
40; Col. 6, line 60-Col. 7, line 25; Eng-Col. 17, lines 22-46). 

Regarding claim 16, claim is analyzed with respect to the combination of 
claims 1 and 6. 

Regarding claim 17, claim is analyzed with respect to claim 1 . Piotrowski 
in view of Blackketter in view of Eng further teaches the generating of the 
reference clock value, the multimedia document, and the media data, 
respectively, are carried out by at least one processor (Piotrowski-Fig. 1 , el. 50; 
Eng-Col. 17, lines 8-14). 
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Regarding claim 19, claim is analyzed with respect to claim 3. 

Regarding claim 21 , claim is analyzed with respect to claim 5. 

Regarding claim 22, claim is analyzed with respect to claim 6. Piotrowski 
in view of Blackketter in view of Eng further teaches the generating of the 
reference clock value, the multimedia document, and the media data, 
respectively, are carried out by at least one processor (Piotrowski-Fig. 1 , el. 50; 
Eng-Col. 17, lines 8-14). 

Regarding claim 24, claim is analyzed with respect to claim 8. 

Regarding claim 26, claim is analyzed with respect to claim 10. 

Regarding claim 27, claim is analyzed with respect to claim 1 1 . 

Regarding claim 28, claim is analyzed with respect to claim 12. 

Regarding claim 29, claim is analyzed with respect to claim 13. 

Regarding claim 30, claim is analyzed with respect to claim 14. 
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Regarding claim 31 , claim is analyzed with respect to claim 15. 

Regarding claim 32, claim is analyzed with respect to the combination of 
claims 1 and 6. Piotrowski in view of Blackketter in view of Eng further teaches 
the generating of the reference clock value, the multimedia document, and the 
media data, respectively, are carried out by at least one processor (Piotrowski- 
Fig. 1, el. 50; Eng-Col. 17, lines 8-14). 

Regarding claim 35, Piotrowski (Para. 42-45) in view of Blackketter in view 
of Eng teaches a computer-readable recording medium in which a program for 
executing the method of claim 17 in a computer is recorded. 

Regarding claim 36, Piotrowski (Para. 32-37) in view of Blackketter in view 
of Eng teaches the media data generator/transmitter generates and transmits 
media data separately from the generated multimedia document, i.e. the 
multimedia document contains the URLs that link to the media data. 

Regarding claim 37, Piotrowski (Para. 28, 32-37) in view of Blackketter in 
view of Eng teaches the media data receiver/storage receives and stores first 
media data separately from the multimedia document, i.e. the multimedia 
document contains the URLs that link to the media data. 
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7. Claims 4, 9, 20, 25, 33, 34 and 35 are rejected under 35 U.S.C. 1 03(a) as being 
unpatentable over Piotrowski in view of Blackketter in view of Eng and further in view of 
the Real-Time Streaming Protocol Specification (RFC 2326). 

Regarding claim 4, Piotrowski in view of Blackketter in view of Eng 
teaches all elements of claims 1 and 3. 

Piotrowski in view of Blackketter in view of Eng teaches communication 
with a network using well-known conventional communication protocols 
(Piotrowski-Para. 22). 

Piotrowski in view of Blackketter in view of Eng does not clearly teach the 
predetermined data stream is composed of type information, time slot 
information, payload length information, and payload information, the type 
information indicates whether the predetermined data stream is for the reference 
clock value, the multimedia document, or the media data, the time slot 
information indicates a broadcasting time zone in which the reference clock 
value, the multimedia document, or the media data is scheduled, the payload 
length information indicates the length of the payload information, and the 
payload information is substantial data information of the reference clock value, 
the multimedia document, or the media data. 

The RTSP Specification teaches an RTSP response can be composed of 
type information, (Page 7; Page 30, Sec. 10.2; Page 49, Sec. 12.16, 12.18, 
12.19; Page 52, Sec. 12.29; Page 53, Sec. 12.33; Page 79, Sec. C.1.1; Page 80, 
Sec. C.1 .2, C.1 .3), time slot information, i.e. range of presentation or time of 
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availability (Page 52, Sec. 1 2.29; Page 81 , Sec. C.1 .5, C.1 .6), payload length 
information, i.e. content length (Page 30, Sec. 10.2; Page 49, Sec. 12.14), and 
payload information, i.e. entity (Page 30, Sec. 10.2; Page 26, Sec. 8). 

Therefore, it would have been obvious to one of ordinary skill in the art at 
the time the invention was made to modify Piotrowski in view of Blackketter in 
view of Eng to include teach the predetermined data stream is composed of type 
information, time slot information, payload length information, and payload 
information, the type information indicates whether the predetermined data 
stream is for the reference clock value, the multimedia document, or the media 
data, the time slot information indicates a broadcasting time zone in which the 
reference clock value, the multimedia document, or the media data is scheduled, 
the payload length information indicates the length of the payload information, 
and the payload information is substantial data information of the reference clock 
value, the multimedia document, or the media data, as taught by the RTSP 
Specification, for the purpose of using a well-known and established 
communication protocol. 

Regarding claim 9, claim is analyzed with respect to claim 4. 

Regarding claim 20, claim is analyzed with respect to claim 4. 

Regarding claim 25, claim is analyzed with respect to claim 4. 
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Regarding claim 33, claim is analyzed with respect to the combination of 
claims 1 and 4. 

Regarding claim 34, Piotrowski in view of Blackketter in view of Eng in 
view of the Real-Time Streaming Protocol Specification teaches the type 
information, the time slot information, the payload length information, and the 
payload information are sequentially arranged. It would have been obvious to 
one of ordinary skill in the art at the time the invention was made because 
sequentially arranging the type information, the time slot information, the payload 
length information, and the payload information is a predictable variation of the 
RTSP standard. This enables the receiver to quickly process the RTSP header 
fields. 

Regarding claim 35, Piotrowski (Para. 42-45) in view of Blackketter in view 
of Eng in view of RFC 2326 teaches a computer-readable recording medium in 
which a program for executing the method of claims 20 and 25 in a computer is 
recorded. 
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Conclusion 

8. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1 .136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the mailing date of this final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to JEREMY DUFFIELD whose telephone number is 
(571)270-1643. The examiner can normally be reached on Mon.-Thurs. 8:00 A.M. -5:30 
P.M. EST. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Scott Beliveau can be reached on (571) 272-7343. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 



7 August 2009 
JSD 

/Scott Beliveau/ 

Supervisory Patent Examiner, Art Unit 2427 



